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In honor of Dick Palais 

Abstract. Let K he a compact Lie group and W a finite-diniensional real ii'-niodule. Let 
X be a -ftT-stable real algebraic subset of W. Let I{X) denote the ideal of X in M.[W] and let 
Ik{X) be the ideal generated by I{X)^ . We find necessary conditions and sufficient conditions 
for X{X) = Ik{X) and for ^Ik{X) = I{X). We consider analogous questions for actions of 
complex reductive groups. 



1. Introduction 

Let K he a. compact Lie group, let be a finite-dimensional real i^-module and let X C 
be /T- invariant and real algebraic (the zero set of real polynomial functions on W). Let X(X) 
denote the ideal oiX in W^W]. Let M.\W]^ denote the i^-invariants in W^W] and let Xk{X) be the 
ideal generated by X{ X)^ := X (X) nR[iy]^. We say that X is K -reduced if X;^(X) = X{X) and 
almost K -reduced if \JXk{X) = X{X). Let Kw be an orbit in W. Then the slice representation 
at w is the action of the isotropy group on N^, where X^ is a K^^j-complement to Tyj{Kw) 
in ~ TuiiW). An orbit Kw C is principal (resp. almost principal) if the image of in 
GL[Nyj) is trivial (resp. finite). We denote the principal (resp. almost principal) points of W 
by VTpr (resp. VFapr) and we set Xpr := Wp^ fl X and Xapr := H4,pr H X. The strata of W are 
the collections of points S <ZW whose isotropy groups are conjugate. There are finitely many 
strata. If M.\W] is a free ^-module, then we say that W is cofree. In the following, when 
we talk about one set being dense in another, we are referring to the Zariski topology. 

Here are our main results: 

Theorem 1.1. If X is K-reduced (resp. almost K-reduced), then X^^ (resp. X.^^^) is dense in 
X, and conversely if W is cofree. 

Theorem 1.2. Let w G W . Then the orbit Kw is K-reduced (resp. almost K-reduced) if and 
only if Kw is principal (resp. almost principal). 

To prove the results above and to obtain further results we need to complexify. Let V = 
W ®M C and G = Kc be the complexifications of W and K. We have the quotient morphism 
vr: y — )■ V//G where vr is surjective, V//G is an affine variety and 7t*C[V//G] = C[V]'-^. We have 
the Luna strata of the quotient V//G whose inverse images in V are the strata of V. The strata 
of V are in 1-1 correspondence with those of W [SchSO, §5]. Let Y = Xc be the complexification 
of X (the Zariski closure of X in V). We say that Y is G -saturated if Y = 7r~^{7r{Y)) and that 
Y is G-reduced if the ideal X(Y) of Y is generated by X(y)*^. We can define Yapr and as 
above (see §3). If /i, . . . , /fc are functions on a complex variety, let X(/i, ■ ■ ■ , fk) denote the ideal 
they generate. 

Theorem 1.3. (1) X is almost K-reduced if and only ifY is G-saturated. 

(2) X is K-reduced if and only if Y is G-reduced. 

(3) Xapr (resp. Xp^) is dense in X if and only ifY^^^ (resp. Y^^) is dense in Y . 
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Theorem 1.4. Assume that Y//G C V//G is the zero set of fi, . . . , fk- 

(1) Suppose that Y^pr is dense in Y and that for any stratum SofV which intersects F \Yapr 
the codimension of S in V is at least k + 1. Then Y is G-saturated.. 

(2) Suppose that Ypr is dense in Y and that Y is G-saturated. In addition, suppose that 
X{tt{Y)) = X(/i, . . . , fk) where Y has codimension k in V. Then Y is G-reduced. 

Corollary 1.5. If (1) above holds, then X is almost K-reduced. If (2) holds, then X is K- 
reduced. 

In sections 2-4 we consider when a general G-invariant Y (ZV is G-saturated or G-reduced 
and we establish Theorem 1.4. In section 5 we treat the real case by complexifying. At the end 
of section 5 we establish Theorems 1.1, 1.2 and 1.3. 

D. Z. Dokovic posed the question of identifying the X which are /T- reduced. Our results give 
a partial answer. We thank M. Rais for transmitting the question to us. We thank the referee 
for a careful reading of the manuscript, helpful suggestions and Lemma 3.3. 

2. The complex case 

Let G be a complex reductive group and Y an affine algebraic set with an algebraic G-action. 
Dual to the inclusion C[y]'^ C C[y] we have the quotient morphism vry : F — )■ Y//G. Let V be 
a finite-dimensional G-module and let F be a G-stable algebraic subset of V (the zero set of 
an ideal of C[V^]). We shall denote vry simply by tt. Then vry = tt\y and i^iY) ~ Y//G is an 
algebraic subset of V//G. We say that Y is G-saturated if F = 7r^^(7r(F)). Let X{Y) denote 
the ideal of Y in 'C\V] and let Tg{Y) denote the ideal generated by We say that Y is 

G-reduced if X(F) = Xg{Y). The null cone MiV) ofV is the fiber Ti-\n{Q)). Then UiV) is 
(scheme theoretically) defined by the ideal Xg'({0}) so that the scheme NiV) is reduced if and 
only if the set NiV) is G-reduced, in which case we say that V is coreduced. See [KSll] for 
more on coreduced representations. 

The points of V//G are in one-to-one correspondence with the closed G-orbits in V . The Luna 
strata of V//G are the sets of closed orbits whose isotropy groups are all G-conjugate. There 
are finitely many strata in V//G, and we consider their inverse images in V to be the strata of 
V . Let V ^ V such that Gv is closed. Then the isotropy group G„ is reductive, and there is a 
Gt,-stable complement A^^, to T^iGv) in ^ T^{y). We call the action of G^ on the slice 
representation at v. 

We start with some examples. 

Example 2.1. Let (V, G) = (/cC", SL„), k > n. The invariants are generated by the determinants 
detj^^...^j,^ where the indices 1 < «i < ■ ■ ■ < in < ^ tell us which n copies of to take. Then V 
is coreduced since N'iV) is the determinantal variety of {k x ?T,)-matrices of rank at most n — 1. 
See also [KSll]. All orbits outside the null cone are closed with trivial isotropy group, hence 
are principal. 

Example 2.2. Let G C GL{V) be finite and nontrivial. Then J^{V) is the origin which is 
G-saturated but not G-reduced. 

Part (2) of the proposition below follows from Serre's criterion for reducedness [MatSO, Ch. 
7]. Part (1) also follows, using the Jacobian criterion for smoothness. 

Proposition 2.3. Let Y G V be a G-saturated algebraic set. 

(1) // Y is G-reduced, then for every irreducible component Yk of Y there is a point of Yk 
where rank / = codim Y^. Here f = (/i, . . . , fa): V ^ and the fi generate Xg(Y). 

(2) If Xg(Y) = X(/i,...,/rf) where the fi G €[1^]*^ and Y has codimension d, then Y is 
G-reduced if and only if the rank condition of (1) is satisfied. 
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Example 2.4. Let G = S03(C) acting as usual on V = 2C^. Then the invariants are generated 
by inner products fij, I < i < j < 2. Each copy of has a weight basis {v2,Vo,v_2} relative 
to the action of the maximal torus T = C* where vj has weight j. The null cone Y := N'iV) 
is the G-orbit of all the vectors v = {av2, /3v2) for a, /3 e C. But one easily calculates that the 
rank of (/n, f22, /12) '■ ^ — )■ C'^ at w is at most 2 while Y has codimension 3. Thus the null cone 
is not G-reduced. 

3. The case where Ypr or Fapr is dense in Y 

Throughout this section we assume that is a stable representation of G, i.e., there is a 
nonempty open subset of closed orbits. This is always the case when {V, G) = (Wc, Kq) is 
a complexification ([Lun72] or [SchSO, Cor. 5.9]). Let Gv be a closed orbit. We say that 
Gv is principal if the slice representation [N^^G^) is a trivial representation and that Gv is 
almost principal if G^ — GL{Ni) has finite image. We denote the principal (resp. almost 
principal) points of V by Vpr (resp. Kpr). If F C V is G-stable, we set Y-p^ = F fl Vpr and 
Fapr = F n Kpr- Both Fapr and Fpr are open in F. In general, the fiber of tt through a closed 
orbit Gv C ^ is G x*^" JV{N^) (the G-fiber bundle with fiber J\f{N^) associated to the Gy- 
principal bundle G — > G/Gi,). Thus the fiber is set-theoretically the orbit if and only A/'(A^„) 
is a point. This happens if and only if the image G„ — > GL(A'^u) is finite, i.e, v G Vapr. Hence 
Fapr is always G-saturated. Similarly, the fiber is scheme-theoretically the orbit if and only if 
J\f{Ny) is schematically a point which is equivalent to G„ acting trivially on N^, i.e., we have 
V e Vpr- Hence Fpr is always G-reduced. To sum up we have 

Proposition 3.1. Let Gv be a closed orbit and letYcV be a G-stable algebraic set. 

(1) IfY = Fapr, then Y is G-saturated. In particular, Gv is G-saturated if and only if it is 
almost principal. 

(2) If Y = Fpr, then Y is G-reduced. In particular, Gv is G-reduced if and only if it is 
principal. 

(3) The fiber 7r~^(7r(t;)) is G-reduced if and only if the slice representation {N^^G^) is core- 
duced. 

Corollary 3.2. // the isotropy groups of G acting on Y are all finite, then Y is G-saturated 
and if G acts freely on Y , then Y is G-reduced. 

Of course, it is possible that F is G-saturated (resp. G-reduced) even if Fapr (resp. Fpr) is 
empty. But in the case of a complexification F = Xc it is necessary for G-saturation (resp. 
G-reducedness) that Fapr (resp. Fpr) is dense in F (see §5). We consider the case that V^pr or 
Fpr is not dense in F in the next section. 

Unfortunately, we do not have the analogues of Proposition 3.1(1) and (2) for X. See Example 
5.3 below. 

Recall that V is cofree if C[V] is a free C[y]'^-module. Equivalently, tt: V — )■ V//G is flat, or 
C[y]'^ is a regular ring and the codimension oi Af{V) is dimCfV]*^ [SchSO, Proposition 17.29]. 
We owe the following lemma to the referee. 

Lemma 3.3. Let V be a cofree G-module and let U C V//G be locally closed. 

(1) We have tt~^{U) = n'\U). 

(2) If7i^^{U) is reduced, then so is 7r^^{U). 

Proof. For (1) set Z := 7r~^(f/). Then 7r(Z) is closed [Kra84, II. 3. 2], hence n{Z) = U . Since tt 
is fiat, so is ti~^{U) U. Set S := n'^iJJ) \ Z. Then 5* is open, hence 7r(S') is open in U (by 
flatness). By construction, vr(5') does not meet f/, hence we must have 5 = 0, establishing (1). 
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For (2) we can assume that U = Uf = {ueU \ f{u) ^ 0} for / G C[U]. Set Z := n-\U), 
the schematic inverse image of U. Since C[U] — )■ C[U] = C[U]f is injective and C[Z] is flat 
over C[U], it follows that C[Z] — t- C[Z]/ = C[7r~^(f/)] is also injective. Since the latter ring is 
reduced, so is C[Z] and we have established (2). □ 

Corollary 3.4. Suppose that {V, G) is cofree and that Y G V is a G-stable algebraic set such 
that Fapr is dense in Y . Then Y is G -saturated. 

Example 3.5. Let {V,G) = (4C2, SL2) and let Y = 2C^ x {0}. Then Yp^ = l^apr is dense in Y 
(it is the set of linearly independent vectors in Y) but Y is not G-saturated since it does not 
contain the null cone. The G-module V is not cofree, so we don't contradict Corollary 3.4. Note 
that this example is the complexification of the case where X = x {0} C := © 
and K = SU(2,C). Thus Xpj- = X^pv is dense in X but X is not almost i^-reduced. (We use 
Theorem 1.3.) This shows that cofreeness is also necessary in Theorem 1.1. 

Theorem 3.6. Suppose that Y (Z V is G-stable such that 

(1) Yapr is dense in Y . 

(2) Y//G C V//G is the zero set 0//1, . . . , fk where the minimal codimension of a non almost 
principal stratum of V which intersects Y is at least k -\- 1. 

Then Y is G-saturated. 

Proof. Let Y denote 7r~^(7r(y)). Then each irreducible component of Y has codimension less 
than or equal to k. Let S* be a non almost principal stratum of V which intersects Y. Then 
S* n F is nowhere dense in Y. Thus Fapr is dense in Y. Now Yapr and Yapr have the same image 
in Y//G. Hence Yapr = Yapr and Y = Y is saturated. □ 

Example 3.7. Let {V,G) = (A;C^,SL2), k > 2. The codimension of the null cone is k — 1 and 
the subset Y where the first copy of is zero is not saturated, but corresponds to the subset 
of V//G where the determinant invariants deti2, . . . , deti^ vanish (see Example 2.1). Thus the 
codimension condition in Theorem 3.6(2) is sharp. 

Here is an example that is a complexification. 

Example 3.8. Let (V, G) = {2C\ S02(C)) and let y = x {0} U {0} x C^. Then Fapr is dense 
in Y since any point not in AfiV) is on a principal orbit and AfiV) is nowhere dense in Y. 
However, Y is not G-saturated since it does not contain M'CV). Note that I{Y//G) is generated 
by det (the determinant), /12 and /11/22 where the fij are the inner product invariants. Since 
det^ = /11/22 — /i25 '^0^//^) is the radical of the ideal generated by /12 and /ii/22- The null 
cone has codimension 2. Again this shows that the codimension condition in Theorem 3.6 is 
sharp. 

We now have the following corollary of Lemma 3.3 

Corollary 3.9. Suppose that {V,G) is cofree and that Y G V is G-stable such that "Ypr is dense 
in Y . Then Y is G -reduced. 

Remark 3.10. For Y to be G-reduced, it is not sufficient that every slice representation of 
V is coreduced. (This is the same as saying that every fiber oi n: V V//G is reduced.) 
Just consider Example 3.5 again. Here Ypr is dense in Y but Y is not G-saturated, let alone 
G-reduced. 

Theorem 3.11. Let V be a G-module and let Y G V be G-saturated such that Yp,. is dense in 
Y . Suppose that tt{Y) G V//G is the zero set of fi, . . . , fk where the codimension of Y is k. 
Then Y is G-reduced. 
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Proof. The rank of the differential of / = (/i, . . . , /d) : F — )■ is maximal at a point of each 
irreducible component of Y since Y is reduced at all points of Yp^.. Thus we can apply Serre's 
criterion (Proposition 2.3). □ 

Example 3.12. Let {V, G) = (4C^, SL2(C)) and let Y be the zero set of two of the determinant 
invariants detjj. Then Yp,- is dense in Y since the only non-principal stratum is A/'(V^) which 
has codimension 3 while Y has codimension 2. By Theorem 3.11, Y is G-reduced. 

4. The case where Yp^ or Fapr is not dense in Y 

We can say something in the case that Yapr or ^pr is not dense in Y. We are certainly in this 
case if V is not stable, since then Vp^ and \4pr are empty. Let v & Y such that Gv is closed. 
Let {Ny,Gy) be the slice representation and S the corresponding stratum of V. We say that 
(A^„, Gy) is a generic slice representation for Y if S (lY is dense in an irreducible component of 
Y. We also say that S is generic for Y. 

Proposition 4.1. Let {Ny,Gy) be a generic slice representation of Y corresponding to the 
stratum S of V . If Y is G-saturated, then Y Pi S = ti~^{tt{Y fl S)). If Y is G-reduced, then 
{Ny, Gv) is coreduced. 

Proof. If Y is G-saturated, then we obviously must have that Y r\ S = 7r^-'^(7r(y fl S)). Let Z 
denote vr(5'). Then vr~^(Z) — Z is a fiber bundle with fiber G x^" J\f{Nv). If Y is G-reduced, 
then the bundle is reduced, hence {Ny,Gy) is coreduced. □ 

Let S" be a stratum of V. We say that Y is S -saturated if F fl S* = 7r~-'^(7r(F H 5)). We say 
that Y is S -reduced if Y is S'-saturated and the slice representation (A^^,, G^,) associated to S is 
coreduced. Corresponding to Corollaries 3.4 and 3.9 and Theorems 3.6 and 3.11 we have the 
following result whose proof we leave to the reader. 

Theorem 4.2. Let Y G V be a G-stable algebraic set. 

(1) // V is cofree and Y is S-saturated for every stratum S which is generic for Y , then Y 
is G-saturated. 

(2) // V is cofree and Y is S-reduced for every stratum S which is generic for Y , then Y is 
G-reduced. 

(3) Suppose that Y is S-saturated for every every generic stratum S ofY. Further assume 
that the minimal codimension of the strata ofV which intersect Y but are not generic for 
Y is greater than k and that Y//G is the zero set of fi, . . . , f^. Then Y is G-saturated. 

(4) Suppose that Y is G-saturated and that the ideal of 7r(y) C V//G is generated by 
fi,...,fk where the codimension of Y in V is k. Also assume that Y is S-reduced 
for every generic stratum S ofY. Then Y is G-reduced. 

5. The real case 

Let be a real i^-module where K is compact. Let X G W he real algebraic and i^-stable. 
Now K is naturally a real algebraic group and the action on W is real algebraic. Moreover, every 
orbit of i^' in is a real algebraic set [SchOl]. Let Y := Xq denote the complexification of X 
inside V := W^^C and let G denote the complexification Kc of K. Then G is reductive and V 
is a stable G-module ([Lun72] or [SchSO, Cor. 5.9]). We say that a slice representation (A''^, K^j) 
is a generic slice representation for X if w E X and the corresponding stratum contains a 
nonempty open subset of X. Equivalently, the complexification of {Nw,Kuj) is generic for Y. 

Proposition 5.1. (1) X is almost K-reduced if and only ifY is G-saturated. 
(2) X is K-reduced if and only if Y is G-reduced. 
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(3) The set X^pr (resp. Xpj.) is dense in X if and only if the set Yapr (resp. Ypj.) is dense in 
Y. 

(4) X is almost K -reduced implies that X^pr is dense in X . 

(5) X is K -reduced implies that Xpj- is dense in X . 

Proof The ideal of Y is I{X) ®r C C R[W] ®m C = C[V] and Xk(X ) ®m C = Ig{Y). Thus 
I(Y) = Ig(Y) if and only if X(X) = Xk{X), and X{Y) = ^/T^^ if and only if I{X) = 
■\/Xk{X). Hence we have (1) and (2). For (3), note that X^pr is open in X and that Yapr is open 
in Y . If a stratum 5 of TV is dense in an irreducible component of X, then the corresponding 
stratum of V is dense in an irreducible component of Y . Thus if Xapr is not dense in X, then 
Yapr is not dense in Y . Clearly, if Xapr is dense in X, Yapr ^ Xapr is dense in Y . The argument 
for Xpr and Fpr is similar, hence we have (3). Now suppose that X is almost i^-reduced. Then 
for S a generic stratum of X and x G 5" flX, the complexification Gx ~ G/Gx of Kx is Zariski 
dense in the fiber G x^^ A/'(iya; ®rC) where G^ = (-ft'x)c- Thus M(Wx<S)rC) is a point, i.e., the 
stratum consists of almost principal orbits. Hence we have (4), and (5) is proved similarly. □ 

Corollary 5.2. Let X = Kw he an orbit. Then X is almost K-reduced if and only if Kw is 
almost principal and X is K-reduced if and only if Kw is principal. 

Unfortunately, it is not true that X = Xp^. (or X = Xapr) implies the same equality for Y. 

Example 5.3. Let K = SU2(C) and W = 2C^©]R where K acts as usual on the copies of and 
trivially on M. We consider W to be 2HI © M where HI denotes the quaternions. Then K c:^ S^, 
the unit quaternions, and the action on 2IHI is given by k{p,q) = {kp,kq), p, q E M, k E S^. 
Let p ^ p denote the usual conjugation of quaternions. The invariants of K acting on 2HI are 
generated by {p, q) i— )■ (pp, gg, qp) where the first two invariants lie in M and the last in H. Let 
a and /3 denote the first two invariants and let 7 be the real part of qp. Let 5, e and C be the 
invariants which are the j and k components of qp, respectively. Then there are certainly 
points in 2IHI where 5, e and C vanish and where a = /3 = 7 is any positive real number. Let x 
be a coordinate on the copy of M in and let X be the subset of W defined by5 = e = C = 0, 
a = /3 = 7 and (a — + = 1/2. Then a never vanishes on X which implies that the isotropy 
group at the corresponding point of W is trivial, so we have that X = Xp^. The quotient X/K 
is a smooth curve, hence X is smooth of dimension 4. The complexification Y of X also has 
dimension four and contains some of the points (s, t, ±-y/— 3/4) where (s, t) lies in the null cone 
of 2EI ®ig C ~ 4C^ for the action of K^ ~ SL2(C). But this null cone has dimension 5. Hence Y 
is not G-saturated, let alone G- reduced, and Y ^ Yapr- Moreover, X is neither i^-reduced nor 
almost i^-reduced. 

Now we recover the theorems of the introduction. Theorem 1.2 is just Corollary 5.2. Theorem 
1.3 is a consequence of Proposition 5.1 and Theorem 1.4 follows from Theorems 3.6 and 3.11. 

Proof of Theorem 1.1. Suppose that X is i^-reduced. Then Proposition 5.1 shows that Xp^ is 
dense in X. Conversely, if (VF, K) is cofree (equivalently, (V, G) is cofree) and Xp^. is dense in 
X, then Yp^ is dense in Y by Proposition 5.1 and Y is G-reduced by Corollary 3.9. Hence X is 
i^'-reduced. The proof in the almost i^-reduced case is similar. □ 
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